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(54) Signal encoding method and apparatus 

(57) A method and apparatus for encoding an Input 
signal, such as a broad-range speech signal, in which 
plural decoding operations with different bit rates is en- 
abled for assuring a high encoding bit rate and for min- 
imizing deterioration of the reproduced sound even with 
a low bit rate. The signal encoding method includes a 
band-splitting step for splitting an input signal into plu- 
rality of bands and a step of encoding signals of the 
bands in a different manner depending on signal char- 
acteristics of the bands. Specifically, a low-range side 
signal is taken out by a low-pass filter (LPF) 102 from 
an input signal entering a terminal 101, and analyzed 



for LPC by an LPC analysis quantization unit 130. After 
finding the LPC residuals, as short-term prediction re- 
siduals by an LPC inverted filter 111, the pitch is found 
by a pitch analysis circuit 115. Then, pitch residuals are 
found by long-term prediction by a pitch inverted filter 
112. The pitch residuals are processed with MDCT by a 
modified OCT (MDCT) circuit 113 and vector-quantized 
by a vector-quantization (VQ) circuit 114. The resulting 
quantization indices are transmitted along with the pitch 
lag and the pitch gain. The linear spectral pairs (LSP) 
are also sent as parameter representing LPC coeffi- 
cients. 
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Description 

This invention relates to a method and apparatus for encoding an input signal, such as a broad-range speech 
signal. More particularly, it relates to a signal encoding nnethod and apparatus in which the frequency spectrum is split 
' 5 into a telephone band for which sufficient clarity as speech can be obtained and the remaining band and in which signal 
encoding can be realized by an independent codec as long as the telephone band is concemed. 

There are a variety of methods known for compressing audio signals^ inclusive of speech and acoustic signals, by 
exploiting statistic properties of the audio signals and psychoacoustic characteristics of the human being. The encoding 
methods may be roughly classified into encoding on the time axis, encoding on the frequency axis and analysis syn- 
?o thesis encoding. 

Among the known techniques for high efficiency encoding for speech signals or the like, there are a harmonic 
encoding, a sinusoidal analytic encoding, such as multi-band excitation (MBE) encoding, a sub-band encoding (SBC), 
a linear predictive coding (LPC). discrete cosine transform (DCT). modified DCT (MDCT) and fast Fourier transform 
(FFT). 

75 There have also hitherto been known a variety of encoding techniques for dividing an input signal into plural bands 

prior to encoding. However, since the encoding for the lower frequency range is performed by the same unified method 
as that for the higher frequency range, there are occasions wherein an encoding method appropriate for the low fre- 
quency range signals has only poor encoding efficiency for the encoding of the high frequency range signals, or vice 
versa. In particular, optimum encoding occasionally cannot be performed when the signal is transmitted with a low bit 

20 rate. 

Although the signal decoding devices now in use are designed to operate with various different bit rates, it is 
inconvenient to use different devices for the different bit rates. That is, it is desirable that a sole device can encode or 
decode signals of plural different bit rates. 

Meanwhile, it has recently been a desideratum that a bitstream itself has scalability such that a bitstream having 
^5 a high bit rate is received and, if the bitstream is decoded directly high-quality signals are produced, whereas, if a 
specified portion of the bitstream is decoded, signal of low sound quality are produced. 

Heretofore, a signal to be processed is roughly quantized on the encoding side to produce a bitstream with a low 
bit rate. For this bitstream, the quantization error produced on quantization is further quantized and added to the bit- 
stream of the low bit rate to produce a high bit rate bitstream. In this case, if the encoding method remains essentially 
50 the same, the bitstream can have scalability as described above, that is, a high-quality signal can be obtained by 
directly decoding the high bit rate bitstream, while a low bit rate signal can be reproduced by taking out and decoding 
a portion of the bitstream. 

However, the above-mentioned complete inclusive relation cannot be constituted with ease if it is desired to encode 
the speech at, for example, three bit rates of 2 kbps, 6 kbps and 16 kbps, while maintaining scalability 
35 That is, for encoding with as high signal quality as possible, waveform encoding is preferably performed with a 

high bit rate. If waveform encoding cannot be achieved smoothly encoding has to be performed using a mode! for a 
low bit rate. The above inclusive relation in which the high bit rate includes the low bit rate cannot be achieved because 
of the difference in the information for encoding. 

It is therefore an object of the present invention to provide a speech encoding method and apparatus in which, in 
40 band splitting for encoding, the playback speech with a high quality may be produced with a smaller number of bits, 
and signal encoding for a pre-set band, such as a telephone band, can be realized by independent codec. 

It is another object of the present invention to provide a method for multiplexing encoded signals in which plural 
signals which cannot be encoded by the same method because of a significant difference in the bit rates are adapted 
• to have as much common information as possible and encoded by essentially different methods for assuring scalability. 
45 It is yet another object of the present invention to provide a signal encoding apparatus employing the multiplexing 

method for multiplexing the encoded signal. 

In one aspect, there is provided a signal encoding method including a band-splitting step for splitting an input signal 
into plurality of bands and encoding signals of the bands in a different manner depending on signal characteristics of 
the bands. 

50 In another aspect, the present invention provides a method and apparatus for multiplexing an encoded signal 

having speech encoding means in turn having means for multiplexing a first encoded signal obtained on first encoding 
of an input signal employing a first bit rate and a second encoded signal obtained on second encoding of the input 
signal and means for multiplexing the first encoded signal and a portion of the second encoded signal excluding the 
portion thereof owned in common by the first encoded signal. The second encoding has a portion in common with only 

55 a portion of the first encoding and a portion not in common with the first encoding. The second encoding employs a 
second bit rate different from the bit rate for the first encoding. 

According to the present invention, the input signal is split into plural bands and signals of the bands thus split are 
encoded in a different manner depending on signal characteristics of the split bands. Thus a decoder operation with 
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different rates is enabled and encoding may be performed with an optimum efficiency for each band thus improving 
the encoding efficiency. 

By performing short-term prediction on the signals of a lower side one of the bands for finding short-term prediction 
residuals, performing long-term prediction on the short-term prediction residuals thus found and by orthogonal trans- 
5 forming the long-term prediction residuals thus found, a higher encoding efficiency and a reproduced speech of superior 
quality may be achieved. 

Also, according to the present invention, at least a band of the input signal Is taken out, and the signal of the band 
thus taken out is orthogonal -transformed into a frequency-domain signal. The orthogonal-transformed signal is shifted 
on the frequency axis to another position or band and subsequently inverse orthogonal-transformed to time-domain 
10 signals, which are encoded. Thus the sigrial of an arbitrary frequency band is taken out and converted into a low-range 
side for encoding with a low sampling frequency. 

In addition, a sub-band of an arbitrary frequency width may be produced from an arbitrary frequency so as to be 
processed with a sampling frequency twice the frequency width thus enabling an application to be dealt with flexibly. 

The present invention will be more clearly understood from the following description, given by way of example 
15 only, with reference to the accompanying drawings in which: 

Fig. 1 is a block diagram showing a basic structure of a speech signal encoding apparatus for carrying out the 
encoding method embodying the present invention. 

Fig.2 is a block diagram for illustrating the basic structure of a speech signal decoding apparatus. 

Fig.3 is a block diagram for illustrating the structure of another speech signal encoding apparatus. 
20 Fig.4 illustrates scalability of a bitstream of transmitted encoded data. 

Fig. 5 is a schematic block diagram showing the entire system of the encoding side according to the present In- 
vention. 

Figs.6A, 6B and 6C illustrate the period and the phase of main operations for encoding and decoding. 
Figs.7A and 7B illustrate vector quantization of MDCT coefficients. 
25 Figs.SA and SB illustrate examples of windowing functions applied to a post-fitter output. 

Fig. 9 shows an illustrative vector quantization device having two sorts of codebooks. 

Fig. 10 is a block diagram showing a detailed structure of a vector quantization apparatus having two sorts of 
codebooks. 

Fig. 11 Is a block diagram showing another detailed structure of a vector quantization apparatus having two sorts 
30 of codebooks. 

Fig. 12 is a block diagram showing the structure of an encoder for frequency conversion- 
Figs. 13A. 13B Illustrate frame splitting and overlap-and-add operations. 

Figs.14A. 148 and 14C illustrate an example of frequency shifting on the frequency axis. 

Figs. 15A and 158 Illustrate data shifting on the frequency axis. 
35 Fig. 16 Is a block diagram showing the structure of a decoder for frequency conversion. 

Figs.17A. 17B and 17C illustrate another example of frequency shifting on the frequency axis. 

Fig. 18 is a block diagram showing the structure of a transmitting side of a portable terminal employing a speech 
encoding apparatus of the present Invention. 

Fig. 19 is a block diagram showing the structure of a receiving side of a portable terminal employing a speech 
40 signal decoding apparatus associated with Fig. 18. 

Preferred embodiments of the present invention will now be explained in detail. 

Fig. 1 shows an encoding apparatus (encoder) for broad-range speech signals for carrying out the speech encoding 
method according to the present invention. 

The basic concept of the encoder shown in Fig.1 is that the input signal is split into plural bands and the signals 

^5 of the split bands are encoded in a different manner depending on signal characteristics of the respective bands. 
Specifically, the frequency spectrum of the broad-range input speech signals is split into plural bands, namely the 
telephone band for which sufficient clarity as speech can be achieved, and a band on the higher side relative to the 
telephone band. The signals of the lower band, that is the telephone band, are orthogonal-transformed after short-term 
prediction such as linear predictive coding (LPC) followed by long-term prediction, such as pitch prediction, and the 

50 coefficient obtained on orthogonal transform are processed with perceptually weighted vector quantization. The infor- 
mation concerning long-term prediction, such as pitch or pitch gain, or parameters representing the short-term predic- 
tion coefficients, such as LPC coefficients, are also quantized. The signals of the band higher than the telephone band 
are processed with short-term prediction and then vector-quantized directly on the time axis. 

The modified DCT (MDCT) is used as the orthogonal transform. The conversion length is shortened for facilitating 

55 weighting for vector quantization. In addition, the conversion length is set to 2*^, that is to a value equal to powers of 
2, for enabling high processing speed by employing fast Fourier transform (FFT). The LPC coefficients for calculating 
the weighting for vector quantization of the orthogonal transform coefficients and for calculating the residuals for short- 
term prediction (similarly for a post-filter) are the LPC coefficients smoothly interpolated from the LPC coefficients found 
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in the current frame and those found in the past frame, so that the LPC coefficients used will be optimum for each sub- 
frame being analyzed. In performing the long-term prediction, prediction or interpolation is carried out a number of 
times for each frame and the resulting pitch lag or pitch gain is quantized directly or after finding the difference. Alter- 
natively, a flag specifying the method for interpolation is transmitted. For prediction residuals the variance of which 
5 becomes smaller with an increased number of times (frequency) of prediction, multi-stage vector quantization is carried 
out for quantizing the difference of the orthogonal transform coefficients. Alternatively only the parameters for a sole 
band among the split bands are used for enabling plural decoding operations with different bit rates by all or part of a 
sole encoded bitstream. 

Reference is had to Fig. 1 . 

10 To an input terminal 101 of Fig.1 are supplied broad-band speech signals in a range of, for example, from 0 to 8 

kHz with a sampling frequency Fs of, for example, 16 kHz. The broad-band speech signals from the input terminal 101 
are split by a low-pass filter 102 and a subtracter 106 into low-range telephone band signals of, for example, 0 to 3.8 
kHz, and high-range signals, such as signals in a range of, for example, from 3.8 kHz to 8 kHz. The low-range signals 
are decimated by a sampling frequency converter 103 in a range satisfying the sampling theorem to provide e.g.. 8 

'5 kHz-sampling signals. 

The low-range signals are multiplied by an LPC analysis quantization unit 130 by a Hamming window with an 
analysis length on the order of, for example, 256 samples per block. The LPC coefficients of, for example, 10 order 
that is a-parameters. are found, and LPC residuals are found by an LPC inverted filter 111. During this LPC analysis, 
96 of 256 samples of each block, functioning as a unit for analysis, are overlapped with the next block, so that the 

20 frame interval becomes equal to 160 samples. This frame interval is 20 msec for 8 kHz sampling. An LPC analysis 
quantization unit 1 30 converts the a-parameters as LPC coefficients into linear spectral pair (LSP) parameters which 
are then quantized and transmitted. 

Specifically, an LPC analysis circuit 1 32 in the LPC analysis quantization unit 130, fed with the low-range signals 
from the sampling frequency converter 103, applies a Hamming window to the input signal waveform, with the length 

25 of the order of 256 samples of the input signal waveform as one block, In order to find linear prediction coefficients, 
that is so-called a-parameters, by an autocorrelation method. The framing interval, as a data outputting unit, is e.g., 
20 msec or 160 samples. 

The a-parameters from the LPC analysis circuit 132 are sent to an a-LSP conversion circuit 133 for conversion 
into linear spectra pair (LSP) parameters. That is, the a-parameters, found as direct type filter coefficients, are converted 
30 into, for example, ten LSP parameters, or five pairs of LSP parameters. This conversion is performed using, for example, 
the Newton-Rhapson method. The reason for conversion to the LSP parameters is that the LSP parameters are superior 
to the a-parameters in interpolation characteristics. 

The LSP parameters from the a-LSP conversion circuit 133 are vector- or matrix-quantized by an LSP quantizer 
1 34. The vector quantization may be executed after finding the inter-frame difference, while matrix quantization may 
3S be executed on plural frames grouped together. In the present embodiment, 20 msec is one frame and two frames of 
the LSP parameters, each calculated every 20 msec, are grouped together and quantized by matrix quantization. 

A quantization output of the LSP quantizer 1 34, that is the indices of the LSP vector quantization, is taken out via 
a terminal 1 31 , while the quantized LSP parameters, or dequantized outputs, are sent to an LSP interpolation circuit 1 36. 

The function of the LSP interpolation circuit 136 is to interpolate a set of the current frame and a previous frame 
40 of the LSP vectors vector-quantized every 20 msec by the LSP quantizer 134 in order to provide a rate required for 
subsequent processing. In the present embodiment, an octotuple rate and a quintuple rate are used. With the octotuple 
rate, the LSP parameters are updated every 2.5 msec. The reason is that, since analysis synthesis processing of the 
residual waveform leads to an extremely smooth waveform of the envelope of the synthesized waveform, extraneous 
sounds may be produced if the LPC coefficients are changed rapidly every 20 msec. That is, if the LPC coefficients 
45 are changed gradually every 2.5 msec, such extraneous sound may be prevented from being produced. 

For inverted filtering of the input speech using the interpolated LSP vectors, occurring every 2.5 msecs, the LSP 
parameters are converted by an LSP to a conversion circuit 137 into a-parameters which are the coefficients of the 
direct type filter of, for example, approximately 10 orders. An output of the LSP to a conversion circuit 137 is sent to 
an LPC inverted filter circuit 111 for finding the LPC residuals. The LPC inverted filter circuit 111 executes inverted 
50 filtering on the a-parameters updated every 2.5 msec for producing a smooth output. 

The LSP coefficients, at an interval of 4 msec, interpolated at a quintuple rate by the LSP interpolation circuit 136, 
are sent to a LSP-to a converting circuit 138 where they are converted into a-parameters. These a-parameters are 
sent to a vector quantization (VQ) weighting calculating circuit 1 39 for calculating the weighting used for quantization 
of MDCT coefficients. 

55 An output of the LPC inverted filter 111 is sent to pitch inverted filters 112. 122 for pitch prediction for long-term 

prediction. 

The long-term prediction is now explained. The long-term prediction is executed by finding the pitch prediction 
residuals by subtracting from the original waveform the waveform shifted on the time axis in an amount corresponding 
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to the pitch lag or pitch period as found by pitch analysis. In the present embodiment, the long-term prediction is 
executed by three-point pitch prediction. Meanwhile, the pitch lag means the number of samples corresponding to the 
pitch period of sampled time-domain data. 

That is, the pitch analysis circuit 115 executes pitch analysis once for each frame, that is with the analysts length 

s of one frame. Of the results of pitch analysis, a pitch lag L^, is sent to the pitch inverted filter 112 and to an output 
terminal 142, while a pitch gain is sent to a pitch gain vector quantization (VQ) circuit 116. In the pitch gain VQ circuit 
116, the pitch gain values at three points of the three-point prediction are vector-quantized and a codebook index gi 
is taken out at an output terminal 143, while a representative value vector or a dequantization output is sent to each 
of the inverted pitch filter 1 1 5, a subtracter 1 1 7 and an adder 1 27. The inverted pitch filter 1 1 2 outputs a pitch prediction 

10 residual of the three-point prediction based upon the results of pitch analysis. The prediction residual is sent to, for 
example, an MDCT circuit 113, as orthogonal transform means. The resulting MDCTed output is quantized with per- 
ceptually weighted vector quantization by a vector quantization (VQ) circuit 114. The MDCTed output is quantized with 
perceptually weighted vector quantization by the vector quantization (VQ) circuit 114 by an output of the VQ weighting 
calculation circuit 139. An output of the VQ circuit 114, that is an index IdxVq-,, is outputted at an output terminal 141. 

IS In the present embodiment, a pitch inverted filter 122, a pitch analysis circuit 124 and a pitch gain VQ circuit 126 

are provided as a separate pitch prediction channel. That is, a center of analysis is provided at an intermediate position 
of each pitch analysis center so that pitch analysis will be executed by a pitch analysis circuit 125 at a one-half frame 
period. The pitch analysis circuit 1 25 routes a pitch lag to the inverted pitch filter 1 22 and to an output terminal 1 45. 
while routing the pitch gain to a pitch gain VQ circuit 126. The pitch gain VQ circuit 126 vector-quantizes the three- 

20 point pitch gain vector and sends an index g2 of the pitch gain as a quantization output to an output terminal 1 44, while 
routing its representative vector or a dequantization output to a subtracter 117. Since the pitch gain at the center of 
analysis of the original frame period is thought to be close to the pitch gain from the pitch gain VQ circuit 11 6, a difference 
between dequantization outputs of the pitch gain VQ circuits 116, 126 is taken by a subtracter 117, as a pitch gain at 
the above center of analysis position. This difference is vector-quantized by a pitch gain VQ circuit 118 to produce an 

25 index g^^oi the pitch gain difference which is sent to an output terminal 1 46. The representative vector or the dequan- 
tized output of the pitch gain difference is sent to an adder 127 and summed to the representative vector or the de- 
quantized output from the pitch gain VQ circuit 126. The resulting sum is sent as a pitch gain to the inverted pitch filter 
122. Meanwhile, the index gg of the pitch gain obtained at the output terminal 143 is an index of the pitch gain at the 
above-mentioned mid position. The pitch prediction residuals from the inverted pitch filter 1 22 are MDCTed by a MDCT 

30 circuit 123 and sent to a subtracter 128 where the representative vector or the dequantized output from the vector 
quantization (VQ) circuit 114 is subtracted from the MDCTed output. The resulting difference is sent to the VQ circuit 
124 for vector quantization to produce an index ldxVq2 which is sent to an output terminal 147. The This VQ circuit 
quantizes the difference signal by perceptually weighted vector quantization with an output of a VQ weighting calculation 
circuit 139. • 

35 The high-range signal processing is now explained. 

The signal processing for the high range signals basically consists in splitting the frequency spectrum of the input 
signals into plural bands, frequency-converting the signal of at least one high-range band to the low-range side, lowering 
the sampling rate of the signals converted to the low frequency side and encoding the signals lowered in sampling rate 
by predictive coding. 

40 The broad-range signal supplied to the input terminal 1 01 of Fig.1 is supplied to the subtracter 108. The low-range 

side signal, taken out by the low-pass filter (LPF) 102, such as the telephone band signal in a range of, for example, 
from 0 to 3.8 kHz, is subtracted form the broad-band signal. Thus the subtracter 106 outputs a high-range side signal, 
such as a signal in a range of, for example, from 3.8 to 8 kHz. However, due to characteristics of the actual LPF 102, 
the components lower than 3.8 kHz are left in a minor amount in the output of the subtracter 106. Thus the high-range 

4S side Signal processing is performed on the components not lower than 3.5 kHz. or components net lower than 3.4 kHz. 

This high-range signal has a frequency width of from 3.5 kHz to 8 kHz from the subtracter 106, that is a width of 
4.5 kHz. However, since the frequency is shifted or converted by, for example, down-sampling, to a low range side, it 
is necessary to narrow the frequency range to, for example, 4 kHz. In consideration that the high range signal is 
combined with the low-range signal later on, the range of 3.5 kHz to 4 kHz, which is perceptually sensitive, is not cut, 

50 and the 0.5 kHz range from 7.5 kHz to 8 kHz, which is lower in power and psychoacousticalty less critical as speech 
signals, is cut by the LPF or the band-pass filter 107. 

The frequency conversion to the low-range side, which is then performed, is realized by converting the data into 
frequency domain data, using orthogonal transform means, such as a fast Fourier transform (FFT) circuit 161 , shifting 
the frequency-domain data by a frequency shifting circuit 162, and by inverse FFTlng the resulting frequency-shifted 

55 data by an inverse FFT circuit 164 as inverse orthogonal transform means. 

Form the inverse FFT circuit 164, the high-range side of the input signal, for example, the signal ranging from 3.5 
kHz to 7.5 kHz, converted to a low range side of from 0 to 4 kHz, is taken out. Since the sampling frequency of this 
signal can be represented by 8 kHz. it is down-sampled by a down-sampling circuit 164 to form a signal of a range 
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from 3.5 kHz to 7.5 kHz with the sampling frequency of 8 kHz. An output of the down -sampling circuit 164 Is sent to 
each of the LPC inverted filter 171 and to an LPC analysis circuit 182 of an LPC analysis quantization unit 180. 

The LPC analysis quantization unit 180, configured similarly to the LPC analysis quantization unit 1 30 of the low- 
range side, is now explained only briefly 

s In the LPC analysis quantization unit 1 80, the LPC analysis circuit 1 82, to which is supplied a signal from the down- 

sampling circuit 1 64, converted to the low range, applies a Hamming window, with a length of the order of 256 samples 
of the input signal waveform, as one block, and finds linear prediction coefficients, that is a-parameters, by, for example, 
an auto-correlation method. The a-parameters from the LPC analysis circuit 182 is sent to an a to LSP conversion 
circuit 183 for conversion into linear spectral pair (LSP) parameters. The LSP parameters from the a to LSP conversion 

70 circuit 183 are vector- or matrix-quantized by an LSP quantizer 184. At this time, an inter-frame difference may be 
found prior to vector quantization. Alternatively, plural frames may be grouped together and quantized by matrix quan- 
tization, in the present embodiment, the LSP parameters, calculated every 20 msec, are vector-quantized, with 20 
msec as one frame. 

A quantization output of the LSP quantizer 184. that is an index LSPidxH= is taken out at a terminal 181, while a 
15 quantized LSP vector or the dequantized output, is sent to an LSP interpolation circuit 186. 

The function of the LSP interpolation circuit 186 is to interpolate a set of the previous frame and the current frame 
of the LSP, vectors vector-quantized by the LSP quantizer 184 every 20 msec, to provide a rate necessary for subse- 
quent processing. In the present embodiment, the quadruple rate is used. 

For inverted filtering the input speech signal using the interpolated LSP vectors, occurring at the interval of 5 msec, 
20 the LSP parameters are converted by an LSP-to-a conversion circuit 187 into a-parameters as LPC synthesis filter 
coefficients. An output of the LSP-to-a conversion circuit 187 is sent to an LPC inverted filter circuit 171 for finding the 
LPC residuals. This LPC inverted filter 171 performs inverted filtering by the a-parameters updated every 5 msec for 
producing a smooth output. 

The LPC prediction residual output from the LPC inverted filter 1 71 is sent to an LPC residual VQ (vector quanti- 
25 zation) circuit 172 for vector quantization. The LPC inverted filter 171 outputs an index LPCidx of the LPC residuals, 
which is outputted at an output terminal 173. 

In the above-described signal encoder, part of the low-range side configuration is designed as an independent 
codec encoder, or the entire outputted bitstream is changed over to a portion thereof or vice versa for enabling signal 
transmission or decoding with different bit rates. 
30 That is, when transmitting all data from the respective output terminals of the configuration of Fig. L the transmission 

bit rate becomes equal to 16 kbps (k bits/sec). If data is transmitted from part of the terminals, the transmission bit rate 
becomes equal to 6 kbps. 

Altemativety, if all data from all of the terminals of Fig.1 are transmitted, that is sent or recorded, and all data of 
16 kbps are decoded on the receiving or reproducing side, high<iuality speech signals of 16 kbps may be produced. 
35 On the other hand, if data of 6 kbps is decoded, speech signals having the sound quality corresponding to 6 kbps may 
be produced. 

In the configuration of Fig. 1, output data at the output terminals 131 and 141 to 143 correspond to 6 kbps data. 
If output data at the output terminals 144 to 147, 173 and 181 are added thereto, all data of 16 kbps may be obtained. 
Referring to Fig. 2, a signal decoding apparatus (decoder), as a counterpart of the encoder shown in Fig. 1, is 
40 explained. 

Referring to Fig.2, a vector quantization output of the LSP, equivalent to an output of the output terminal 131 of 
Fig. 1 . that is an index of a codebook LSPidx, is supplied to an input terminal 200. 

The LSP index LSPidx is sent to an inverse vector quantization (inverse VQ) circuit 241 for LSPs of an LSP pa- 
rameter reproducing unit 240 for inverse vector quantization or inverse matrix quantization into linear spectral pair 
45 (LSP) data. The LSP index, thus quantized, is sent to an LSP interpolation circuit 242 for LSP interpolation. The inter- 
polated data is converted in an LSP-to-a conversion circuit 243 into a-parameters, as LPC coefficients, which are then 
sent to LPC synthesis filters 215. 225 and to pitch spectral post-filters 216, 226. 

To input terminals 201, 202 and 203 of Fig.4, there are supplied the index tsxVq^ for vector quantization of the 
MDCT coefficients, a pitch lag L^ and a pitch gain g^ from the output terminals 141 . 142, 143 of Fig.l . respectively. 
50 The index for vector quantization for MDCT coefficients IsxVq^ from the input terminal 201 is supplied to an inverse 

VQ circuit 211 for inverse VQ and thence supplied to an inverse MDCT circuit 212 for inverse MDCT so as to be then 
overlap-added by an overlap-and-add circuit 213 and sent to a pitch synthesis filter 214. The pitch synthesis circuit 
214 is supplied with the pitch lag L^ and the pitch gain g^ from the input terminals 202, 203, respectively. The pitch 
synthesis circuit 214 performs an inverse operation of pitch prediction encoding performed by the pitch inverted filter 
55 215 of Fig.l, The resulting signal is sent to an LPC synthesis filter 215 and processed with LPC synthesis. The LPC 
synthesis output is sent to a pitch spectral post-filter 21 6 for post-filtering so as to be then taken out at an output terminal 
21 9 as speech signal corresponding to a bit rate of 6 kbps. 

To input terminals 204, 205, 206 and 207 of Fig.4 are respectively supplied a pitch gain Q2, a pitch lag L2, an index 
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IsqVqg and a pitch gain g^^i vector quantization of the MDCT coefficients from output terminals 144, 145, 146 and 
147, respectively. 

The index IsxVqg for vector quantization of the MDCT coefficients from the input tenminal 207 is sent to an Inverse 
VQ circuit 220 for vector quantization and thence supplied to an adder 221 so as to be summed to the inverse VQed 

5 MDCT coefficients from the inverse VQ circuit 21 1 . The resulting signal is inverse MDCTed by an inverse MDCT circuit 
222 and overlap-added in an overlap-and-add circuit 223 so as to be thence supplied to a pitch synthesis filter 214. 
To this pitch synthesis filter 224 are supplied the pitch lag L,, pitch gain and the pitch lag Lg from the input terminals 
202. 204 and 205, respectively, and a sum signal of the pitch gain g^ from the input terminal 203 summed to the pitch 
gain g^^ from the input terminal 206 at an adder 217. The pitch synthesis filter 224 synthesizes pitch residuals. An 

10 output of the pitch synthesis filter is sent to an LPC synthesis filter 225 for LPC synthesis. The LPC synthesized output 
is sent to a pitch spectral post-filter 226 for post-filtering. The resulting post-filtered signal is sent to an up-sampling 
circuit 227 for up-sampling the sampling frequency from e.g., 8 kHz to 16 kHz. and thence supplied to an adder 228. 

To the input terminal 207 is also supplied an LSP index LSPidXn of the high range side from the output terminal 
181 of Fig. 1 . this LSP index LSPidXn is sent to an inverse VQ circuit 246 for the LSP of an LSP parameter reproducing 

IS unit 245 so as to be inverse vector-quantized to LSP data. These LSP data are sent to an LSP interpolation circuit 247 
for LSP interpolation. These interpolated data are converted by an LSP-to-a converting circuit 248 to an a parameter 
of the LPC coefficients. The a-parameter is sent to a high-range side LPC synthesis filter 232. 

To an input terminal 209 is also supplied an index LPCidx, that is a vector quantized output of the high-range side 
LPC residuals from the output terminal 1 73 of Fig.1 . This index is inverse VQed by a high-range side inverse VQ circuit 

20 231 and thence supplied to a high-range side LPC synthesis filter 232. The LPC synthesized output of the high-range 
side LPC synthesis filter 232 has its sampling frequency up-sampled by an up-sampling circuit 233 from e.g., 8 kHz 
to 16 kHz and is converted into frequency-domain data by fast FFT by an FFT circuit 234 as orthogonal transform 
means. The resulting frequency -domain signal is then frequency-shifted to a high range side by a frequency shift circuit 
235 and Inverse FFTed by an inverse FFT circuit 236 into high-range side time-domain signals which then are supplied 

25 via an overlap-and-add circuit 237 to the adder 28. 

The time-domain signals from the overlap-and-add circuit is summed by the adder 228 to the signal from the up- 
sampling circuit 227. Thus, an output is taken out at output terminal 229 as speech signals corresponding to a portion 
of the bit rate of 16 kbps. The entire 16 kbps bit rate signal is taken out after summing to the signal from the output 
terminal 219. 

30 Now, scalability is explained. 

In the configuration shown in Figs. 1 and 2, two transmission bit rates of 6 kbps and 16 kbps are realized with 
encoding/decoding systems substantially similar to each other for realizing scalability in which a 6 kbps bitstream is 
completely included in the 1 6 kbps bitstream. If encoding/decoding with a drastically different bit rate of 2 kbps is 
desired, this complete inclusive relation is difficult to achieve- 
rs if the same encoding/decoding system cannot be applied, it is desirable to maintain utmost common ownership 
relation in realizing scalability. 

To this end, the encoder configured as shown in Fig. 3 is used for 2 kbps encoding and a maximum common owned 
portion or common owned data is shared with the configuration of Fig. 1 . The 1 6 kbps bitstream on the whole is flexibly 
used so that the totality of 16 kbps, 6 kbps or 2 kbps will be used depending on usage. 

40 Specifically, the totality of the information of 2 kbps is used for 2 kbps encoding, whereas, in the 6 kbps mode, the 

information of 6 kbps and the information of 5.65 kbps are used if the frame as an encoding unit is voiced (V) and 
unvoiced (UV). respectively. In the 16 kbps mode, the information of 15.2 kbps and the information of 14.85 kbps are 
used if the frame as an encoding unit is voiced (V) and unvoiced (UV), respectively. 

The structure and the operation of the encoding configuration for 2 kbps shown in Fig. 3 is explained. 

4S The basic concept of the encoder shown in Fig. 3 resides in that the encoder includes a first encoding unit 310 for 

finding short-term prediction residuals of the input speech signal, for example, LPC residuals, for performing sinusoidal 
analysis encoding, such as harmonic coding, and a second encoding unit 320 for encoding by waveform encoding by 
phase transmission of the input speech signal. The first encoding unit 310 and the second encoding unit 320 are used 
for encoding the voiced portion of the input signal and for encoding the unvoiced portion of the input signal, respectively 

50 The first encoding unit 310 uses the configuration of encoding the LPC residuals by sinusoidal analysis encoding, 

such as harmonic encoding or multi-band encoding (MBE). The second encoding unit 320 uses the configuration of 
code excitation linear prediction (CELP) employing vector quantization by closed loop search of the optimum vector 
with the aid of the analysis-by-synthesis method. 

In the embodiment of Fig.3, the speech signal supplied to an input terminal 301 is sent to an LPC inverted fitter 

55 31 1 and to an LPC analysis quantization unit 31 3 of the first encoding unit 310. The LPC coefficients or the so-called 
a-parameters obtained by the LPC analysis quantization unit 31 3 are sent to the LPC inverted filter 311 for taking out 
linear prediction residuals (LPC residuals) of the input speech signal. The LPC analysis quantization unit 313 takes 
out a quantized output of the linear spectral pairs (LSPs) as later explained. The quantized output is sent to an output 
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terminal 302. The LPC residuals from the LPC inverted filter 311 are sent to a sinusoidal analysis encoding unit 314 
where the pitch is detected and the spectral envelope amplitudes are calculated. In addition. V/UV discrimination is 
performed by a V/UV discrimination unit 315. The spectra envelope amplitude data from the sinusoidal analysis en- 
coding unit 314 is sent to a vector quantizer 316. The codebook index from the vector quantizer 316, as a vector 

5 quantization output of the spectral envelope, is sent via a switch 317 to an output terminal 303. An output of the 
sinusoidal analysis encoding unit 31 4 is sent via a switch 31 8 to an output terminal 304. The V/UV discrimination output 
of the V/UV discrimination unit 315 is sent to an output terminal 305, while being sent as a control signal to switches 
317, 318. If the input signal is the voiced signal (V), the index and the pitch are selected and taken out at the output 
terminals 303, 304, respectively. 

10 The second encoding unit 320 of Fig-3 has. in the present embodiment, the CELP encoding configuration and 

executes vector quantization of the time-domain waveform using a closed loop search by an analysis by synthesis 
method in which an output of a noise codebook 321 is synthesized by a weighted synthesis filter 322, the resulting 
weighted speech is sent to a subtractor 323 where an error is found from the speech obtained on passing the speech 
signal supplied to the input terminal 301 through a perceptually weighting filter 325, the resulting error is sent to a 

75 distance calculation circuit 324 for distance calculation and a vector which minimizes the error is searched by the nose 
codebook 321. This CELP encoding is used for encoding the unvoiced portion as described above, such that the 
codebook index as the UV data from the noise codebook 321 is taken out at an output terminal 307 via a switch 327 
which is turned on when the result of V/UV discrimination from the V/UV discrimination unit 315 indicated UV. 

The above-described LPC analysis quantization unit 31 3 of the encoder may be used as part of the LPC analysis 

20 quantization unit 1 30 of Fig. 1 , such that an output at the terminal 302 may be used as an output of the pitch analysis 
circuit 115 of Fig. 1 . This pitch analysis circuit 115 may be used in common with a pitch outputting portion within the 
sinusoidal analysis encoding unit 314. 

Although the encoding unit of Fig. 3 thus differs from the encoding system of Fig. 1 . both systems have the common 
information and scalability as shown in Fig, 4. 

25 Referring to Fig. 4, the bitstream S2 of 2 kbps has an inner structure for the unvoiced analysis synthesis frame 

different from one for the voiced analysis synthesis frame. Thus a bitstream S2v of 2 kbps for V is made up of two 
portions 82^^ and 52^3. while a bitstream S2u of 2 kbps for UV is made up of two portions 32^^ and S2^^^. The portion 
S2ve has a pitch lag equal to 1 bit per 160 samples per frame (1 bit/160 samples) and an amplitude Am of 15 bits/160 
samples, totalling at 16 bits/160 samples. This corresponds to data of 0.8 kbps bit rate for the sampling frequency of 

30 8 kHz. The portion S2ye is composed of LPC residuals of 11 bits/80 samples and a spare 1 bit/160 samples, totalling 
at 23 bits/160 samples. This corresponds to data having a bit rate of 1.15 kbps bit rate. The remaining portions 52^3 
and S2ua represent common portions or common owned portions with the 6 kbps and 16 kbps. The portion 32^3 is 
made up of the LSP data of 32 bits/320 samples, V/UV discrimination data of 1 bit/160 samples and a pitch lag of 7 
bits/160 samples, totalling at 24 bits/160 samples. This corresponds to data having a bit rate of 1 .2 kbps bit rate. The 

35 portions 32^3 is made up of the LSP data of 32 bits/320 samples and V/UV discrimination data of 1 bit/160 samples, 
totalling at 17 bits/160 samples. This corresponds to data having a bit rate of 0.85 kbps bit rate. 

Similarly to the bitstream 32ame different in part from one for the voiced analysis frame. The bitstream S6v of 6 
kbps for V is made up of two portions SS^g and 36^^. while the bitstream S6u of 6 kbps for UV is made up of two 
portions 36^3 and 36^^, The portion 36^3 has data contents in common with the portion 32^3 as explained previously. 

40 The portion S6yt> is made up of a pitch gain of 6 bits/160 samples and pitch residuals of 18 bits/32 samples, totalling 
at 96 bits/160 samples. This corresponds to data of 4.8 kbps bit rate. The portion 36^3 has data contents in common 
with the portion S2u3, while the portion 36^^ has data contents in common with the portion S6^^^. 

Similarly to the bitstreams 32 and 36, the bitstream S 1 6 of 1 6 kbps has an inner structure for the unvoiced analysis 
frame different in part from one for the voiced analysis frame. A bitstream 31 6v of 16 kbps for V is made up of four 

45 portions 316^3, 31 6^^. 316^^, and S16v(i, while a bitstream 316u of 16 kbps for UV is made up of four portions 316^3, 
316ub, 316yc and 36^^ The portion 316 ^ghas data contents in common with the portions 32^3, Se^g, while the portion 
316yb has data contents in common with the portions 36yt>, 36^^. The portion S^6^^ is made up of a pitch lag of 2 bits/ 
160 samples, a pitch gain of 11 bits/160 samples, pitch residuals of 18 bits/32 samples and 3/M mode data of 1 bit/ 
160 samples, totaling 104 bits/160 samples. This corresponds to a 5.2 kbps bit rate. The 3/M mode data is used for 

50 switching between two different sorts of codebooks for the speech and for music by the VQ circuit 124. The portion 
S16v<j is made up of a high-range LPC data of 5 blts/1 60 samples and a high -range LPC residuals of 1 5 bits/32 samples, 
totalling at 80 bits/1 60 samples. The corresponds to a bit rate of 4 kbps. The portion 31 6yb has data contents in common 
with the portions 32yg and 36^3, while the portion S^S^^^^ has data contents in common with the portions 31 6^^, that is 
the portions 36^1^ and 36^^ In addition, the portion 316^^ has data contents in common with the portion S16yj., while 

55 the portion 316^^ has data contents in common with the portion 31 6^^- 

The configurations of Figs.1 and 3 for obtaining the above-mentioned bitstream are schematically shown in Fig. 5. 
Referring to Fig. 5. an input terminal 11 corresponds to the input terminal 101 of Figs.1. and 3. The speech signal 
entering the input terminal 11 is sent to a band splitting circuit 12 corresponding to the LPF 102. sampling frequency 
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converter 103, subtracter 106 and BPF 107 of Fig.1 so as to be split into a low-range signal and a high-range signal. 
The low-range signal from the band-splitting circuit 12 is sent to a 2k encoding unit 21 and a connmon portion encoding 
unit 22 equivalent to the configuration of Fig.3. The common portion encoding unit 22 is roughly equivalent to the LPC 
analysis quantization unit 130 of Fig.1 or to the LPC analysis quantization unit 310 of Fig.3. Moreover, the pitch ex- 
5 tracting portion in the sinusoidal analysis encoding unit of Fig.3 or the pitch analysis circuit 115 of Fig.1 may also be 
included in the common portion encoding unit 22. 

The low-range side signal from the band-splitting circuit 1 2 is sent to a 6k encoding unit 23 and to a 1 2k encoding 
unit 24. The 6k encoding unit 23 and the 12k encoding unit are roughly equivalent to the circuits 111 to 116 of Fig.1 
and to the circuits 117. 118 and 122 to 128 of Fig. 1, respectively 
JO The high-range side signals from the band-splitting circuit 12 are sent to a high-range 4k encoding unit 25. This 

high-range 4k encoding unit 25 roughly corresponds to the circuit 161 to 164. 171 and 172. 

The relation of the bitstreams outputted by output terminals 31 to 35 of Fig.5 and various parts of Fig. 4 is now 
explained. That is, data of the portions 52^^ or 32^^ of Fig. 4 is outputted via output terminal 31 of the 2k encoding unit 
21 , while data of the portions 52^^ (= Se^a = Ihe^a) or S2 ^^{= S6 SI 6 of Fig.4 is outputted via output terminal 
15 32 of the common portion encoding unit 21. Moreover data of the portions SS^b (= 316^^) or Se^j^ (= S16 oi Fig.4 
is outputted via output terminal 33 of the 6k encoding unit 23, while data of the portions 316^^ or 31 6^^ of Fig.4 is 
outputted via output terminal 34 of the 1 2k encoding unit 24 and data of the portions 31 6^^ or 31 6^^ of Fig.4 is outputted 
via output terminal 35 of the high-range 4k encoding unit 25. 

The above-described technique for realizing scalability may be generalized as follows: That is, when multiplexing 
20 a first encoded signal obtained on first encoding of an input signal and a second encoded signal obtained on second 
encoding of the input signal so as to have a portion in common with a part of the first encoding signal and another 
portion not in common with the first encoded signal, the first encoding signal is multiplexed with the portion of the 
second encoded signal excluding the portion in common with the first encoded signal. 

In this manner, if two encoding systems are essentially different encoding systems, the portions that can be treated 
25 in common are co-owned by the two systems for achieving scalability 

The operations of the components of Figs.1 and 2 will be explained more specifically. 

It is assumed that the frame interval is N samples, such as 1 60 samples, and analysis is performed once per frame, 
as shown in Fig.6A. 

If, with the center of pitch analysis is t = kN, where k = 0, 1, 2, 3, .... the vector with N dimensions, made up of 
30 components present in t = kN-N/2 to kN + N/2, of the LPC prediction residuals from the LPC inverted filter 111, is X. 
and the vectors with N dimensions made up of components present in t = kN-N/2+L to kN + N/2-L, shifted by L samples 
forwardly along the time axis, are termed Xl, L = Lop, is searched for minimizing 



3$ 



45 



SO 



I|x-9k/ 



this Lgp, being used as an optimum pitch lag L^ for this domain. 

Alternatively, the value obtained after pitch tracking may be used as an optimum pitch lag L^ for avoiding abrupt 
pitch changes. 

40 Next, for this optimum pitch lag L^, a set of g-, minimizing 



D -\\K- J: gX p 



is solved for 



1^=0 



where i = - 1, 0. 1. in order to find a pitch gain vector The pitch gain vector 5^ is vector-quantized to give a code 
index g^. 

For further raising the prediction accuracy, it is envisaged to put the center of analysis additionally at t = (k-1/2)N. 
ss It is assumed that the pitch lag and the pitch gain for t ~ kN and t = (k-1)N have been found previously. 

In the case of a speech signal, it may be assumed that its fundamental frequency is changed gradually, so that 
there is no significant change between the pitch lag L(kN) for t = kN and the pitch lag L((k-1 )N) for t = {k-1 )N. with the 
change being linear. Therefore, limitations may be imposed on the value that can be assumed by the pitch lag L((k- 
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1/2)N) for t = (k-1/2)N. Thus, in the present embcxJiment, 

L ((k-l/2)N) = L(kN) 

= (L(kN) + L ((k-l)N)/2 
= L((k-1)N) 

10 Which of these values is used is determined by calculating the power of the pitch residuals corresponding to the 

respective lags. 

That is, it is assunned that the vector with the nunnber of dinnensions N/2 of t = {k-1/2)N-N/4 (k-1/2)N + N/4 
centered about t = (k-1/2)N is X, the vectors with the number of dimensions N/2 delayed by L(kN), (L(kN) + L((k-1)N)) 
/2 and L((k-1)N) are. X^^^l. X/O)^ X2^^\ respectively, and vectors in the vicinity of these vectors Xq^o), X/O), x^O) are 
IS Xo^'^^Xq. <^*Xi: <^>Xi=<'^>><2^t"^>X2^ *^* Also, for pitch gains go, gi and ga associated with these vectors Xo<'\ Xi<'>,X2^'\ 
where i = -1 , 0, 1 , the lag for the least one D| of 



^2 = 11^ - Tgi'^^'f 

i 

30 

is assumed to be an optimum lag L2 at t = (k-1/2)N, and the corresponding pitch gain gj^'), where i = -1 , 0, 1 Js vector- 
quantized to find the pitch gain. Meanwhile, Lg can assume three values, which can be found from current and past 
values of L^. Therefore, a flag representing an interpolation scheme may be sent as an interpolation index in place of 
35 a straight value. If any one of L(kN) and L((k-1 )N) is judged to be 0, that is devoid of pitch and the pitch prediction gain 
cannot be obtained, the above-mentioned (L(kN) + L({k-1)N))/2 as a candidate for L((k-1/2)N) is discarded. 

If the number of dimensions of the vector X used for calculating the pitch lag is reduced to one halt, or to N/2, Lj^ 
for t = kN as the center of analysis may be directly employed. However, the gain needs to be calculated again to transmit 
the resulting data, despite the fact that the pitch gain for the number of dimensions N of X is available. Here. 

40 

Sid "3 1 " 

is quantized for reducing the number of bits, where g^ is the quantized pitch gain (vector) as found for the length of 
45 analysis = N and^ ' is the non-quantized pitch gain as found for the length of analysis = N/2. 

Of the elements (go, gi , gg) oi the vector _g, g^ is largest, while go and g2 are close to zero, or vice versa, with the 
vector 5 having the strongest correlation among the three points. Thus the vector is estimated to have smaller 
variance than the original vector 5, such that quantization can be achieved with a smaller number of bits. 
Therefore, there are five pitch parameters to be transmitted in one frame, namely L-,, g^. L2, g2 and g^^, 
50 Fig.SB shows the phase of the LPC coefficients interpolated with a rate eight times as high as the frame frequency. 

The LPC coefficients are used for calculating prediction residuals by the inverted LPC filter 111 of Fig.1 and also for 
the LPC synthesis filters 215, 225 of Fig.2 and for the pitch spectral post-filters 216, 226. 

The vector quantization of pitch residuals as found from the pitch lag and from the pitch gain is now explained. 
For facilitated and high-precision perceptual weighting of the vector quantization, the pitch residuals are windowed 
55 with 50% overlap and transformed with MDCT. Weighting vector quantization is executed in the resulting domain. 
Although the transform length may be set arbitrarily, a smaller number of dimensions is used in the present embodiment 
in view of the following points. 
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(1 ) If vector quantization is of a larger number of dimensions, the processing operations become voluminous, thus 
necessitating splitting or re-arraying in the MDCT domain. 

(2) Splitting makes It difficult to perform accurate bit allocation among the bands resulting from splitting. 

(3) If the number of dimensions is not a power of 2. fast operations of f^/lDCT employing FFT cannot be used. 

Since the frame length is set to 20 msec (= 160 samples/ 8 kHz), 160/5 = 32 = 2^. and hence the MDCT transform 
size is set to 64 in view of 50% overlap for possibly solving the above points (1 ) to (3). 
The state of framing is as shown in Fig.6C. 

That is, in Fig.6C. pitch residuals rp(n) in a frame of 20 msec = 160 samples, where n = 0= 1. ...191, are divided 
into five sub-frames, and the pitch residuals rpj{n) of the i'th one. of the five sub-frames, where i = 0, 1 , ... 4, are set to 



= ^ {32i + n) 

IS where n = 160, ...191 implies 0. ...31 of the next frame. The pitch residuals rpj{n) of this sub-frame are multiplied with 
a windowing function w(n) capable of canceling the MDCT aliasing to produce w(n)npj(n) which is processed with 
MDCT transform. For the windowing function w(n), 



20 



w i n) =J (^-(cos2K^n+0.5) )/64) 



25 



30 



may. for example, be employed. 

Since the MDCT transform is of the transform length of 64 (=2®), the transform calculations may be performed 
using FFT by: 

(1) setting X (n) = w(n)*rpi-exp((-27ci/64)(n/2)) ; 

(2) processing x(n) with 64-potnt FFT to produce y(k): and 

(3) taking a real part of y(k)«exp((-27cj/64)(k + 1/2 + 64/4)) and setting the real part as a MDCT coefficient Cj(k), 
where k = 0, 1. ...31. 

The MDCT coefficient Cj(k) of each sub-frame is vector-quantized with weighting, which is now explained. 
If the pitch residuals rpj(n) is set as a vector ^j, the distance 



35 



40 



MH 'HM = 



0 



45 following the synthesis is represented by 



50 



SS 



= i|H(i- - ' 
= (L, - '^Li)'H'H(Li- ^Li 

= iu - '^O'MH'HM M(L i- '^L)i 



where H is a synthesis filter matrix, M is a MDCT matrix. Cj is a vector representation of CjC*) and Cj is a vector repre- 
sentation of quantized Cj^**). 
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Since M is thought to diagonalize H"H, where H' is a transposed matrix of H, by its properties, 



10 



MH'HM = 



hi 0 



hi. 



15 



20 



25 



30 



where n 64 and h; is set as a frequency response of the synthesis filter. Therefore, 



If is directly used for weighting for quantizing Ci(k), the noise after synthesis becomes flat, that is 100% noise 
shaping is achieved. Thus the perceptual weighting W is used for controlling so that the formant will beconne a noise 
of a similar shape. 



W 



0 

0 - 



35 (n rr 64) 

Meanwhile, hj^ and Wj2 may be found as an FFT power spectrum of the impulse response 



40 



H{z) = 



1 * 



4S 



1 -EW 

W{z) = 



V 



50 



1 

^=1 



of the synthesis filter H(z) and the perceptual weighting filter W{2) where P is the number of analysis and . X^, are 
55 coefficients for weighting. 

In the above equations. Ojj is an LPC coefficient corresponding to the i'th sub-frame and may be found from the 
interpolated LPC coefficient. That is. LSPqG) obtained by the analysis of the previous frame.and LSP^O) the current 
frame are intemally divided and, in the present embodiment, the LSP of the i*th sub-frame is set to 
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where i = 0, 1 . 2, 3, 4. to find LSp('i(j). aj^) is then found by LSP to a conversion. 
5 For H and W, thus found. W is set so as to be equal to WH (W = WH) for use as a measure of the distance for 

vector quantization. 

The vector quantization is performed by shape and gain quantization. The optimum encoding and decoding con- 
ditions during leaming are now explained. 

If the shape codebook at a certain time point during learning is s, the gain codebook is 5. the input during training, 
^0 that is the MDCT coefficient in each sub-frame is x and the weight for each sub-frame is W, the power for the 
distortion at this time is defined by the following equation: 

= ||W' (X - gs)f 



IS 



20 



25 



30 



40 



50 



The optimum encoding condition is selection of (g, s) which wit! minimize D^. 

= ^Hv^H-'^W - -I 

Therefore, as a first step, S which maximizes 

, t 't '2 
(s w wx) 



35 t 't ' 

s w ws 



is searched for the shape codebook and, for the gain codebook. is searched for a shape codebook and g^p, closest to 



s^opt w^wx 
sopt w^wsopt 



45 is searched for the gain codebook for this s Qpj. 

Next, the optimum decoding condition is found. 

As the second step, since the sum Eg for the distortion for a set Xk = 0 ••' of x encoded in the shape 
codebook s at a certain point during learning is 



55 s which minimizes the sum is found by 
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3^. 



Bs 



5 as 



10 



As for the gain codebook, the sum of the distortion Eg of a set Xk. with a weight \N\ and the shape s^ of x encoded 
in the gain codebook g is 

IS 



20 

so that, from 



25 



30 



* M-l 



k=0 2 



*=0 



The shape and gain codebooks may be produced by the generalized LLoyd algorithm while the above first and 
35 second steps are found repeatedly. 

Since importance is attached to the noise for the low signal level in the present embodiment, learning is executed 
using W/|[>^| weighted with a reciprocal of the level, in place of W itself. 

The MDCTed pitch residuals are vector-quantized, using the codebook thus prepared, and the index thereby ob- 
tained is transmitted along with the LPC (in effect LSP), pitch and the pitch gain. The decoder side executes inverse 
40 VQ and pitch-LPC synthesis to produce the reproduced sound. In the present embodiment, the number of times of 
pitch gain calculations Is increased and the pitch residual MDCT and vector quantization are executed in multiple 
stages for enabling a higher rate operation. 

An illustrative example is shown in Fig. 7 A, in which the number of stages is two and the vector quantization is 
sequential multi-stage VQ. An input to the second stage is the decoded result of the first stage subtracted from pitch 
45 residuals of higher precision produced from Lg. gg and g^^. That is. an output of the first-stage MDCT circuit 113 is 
vector-quantized by the VQ circuit 114 to find the representative vector or a dequantized output which is inverse MD- 
CTed by an inverse MDCT circuit 1 1 3a. The resulting output is sent to a subtracter 1 28' for subtraction from the residuals 
of the second stage (output of the inverted pitch fitter 1 22 of Fig.1 ), An output of the subtracter 1 28' is sent to a MDCT 
circuit 123' and the resulting MDCTed output is quantized by the VQ circuit 1 24. This can be configured similarly to the 
50 equivalent configuration of Fig.7B in which MDCT is not performed. Fig.1 uses the configuration of Fig.7B. . 

If decoding by the decoder shown in Fig. 2 is performed using both of the indices IdxVqi and I^^V q2 ^^e MDCT 
coefficients, the sum of results of inverse VQ of the indices l<jxVqi and I^x^qa 's inverse MDCTed and overlap-added. 
Subsequently, pitch synthesis and LPC synthesis are performed to produce the reproduced sound. Of course, the pitch 
lag and pitch gain updating frequency during pitch synthesis is twice that of the single stage configuration. Thus, in the 
55 present invention, the pitch synthesis filter is driven as it is changed over every 80 samples. 
The post -filters 216, 226 of the decoder of Fig.2 are now explained. 

The post-filters realize post-filter characteristics p(Z) by pitch emphasis, high range emphasis and a tandem con- 
nection of spectrum emphasis filters. 
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P 



1 - Erla/-^ 

Piz) = \ (1 - Y.^-') 



In the above equation, Qj and L are the pitch gain and the pitch lag as found by pitch prediction, while v is a 
^0 parameter specifying the intensity of pitch ennphasis, such as v = 0.5. On the other hand, is a paranneter specifying 
high-range emphasis, such as = OA, while and v^^ are parameters specifying the intensity of spectrum emphasis, 
such as = 0.5, v^^ = 0.8. 

The gain correction is then made on the output s(n) of the LPC synthesis filter and the output Sp{n) of the post- 



filter with the coefficient k^^^ such that 



t = 

adj j^.^ 

E (^.("))' 



where N = 80 or 160. Meanwhile, kg^j Is not fixed in a frame and is varied on the sample basis after being passed 
25 through the LPR For example, p equal to 0.1 is used. 

30 For smoolhing the junction between frames, two pitch emphasis filters are used, and the cross-faded result of the 

filtering is used as an ultimate output. 



1. 



1 - yXso,-""" 



1 - Y,E^/ -'" 

For the outputs Spo(n) and Sp(n) of the post-filter, thus configured, an ultimate output Som(n) is 



where f(n) is a window shown for example in Fig.8. Figs.SA and 8B show the windowing functions for the low-rate 
operation and for the high-rate operation, respectively. The window with a width of 80 samples of Ftg.SB is used twice 
during synthesis of 160 samples (20 msec). 

The encoder side VQ circuit 124 shown in Fig.1 is explained. 
55 This VQ circuit 1 24 has two different sorts of codebooks for speech and for music switched and selected responsive 

to the input signal. That is, if the quantizer configuration is fixed for quantization of musical sound signals, the codebook 
owned by the quantizer becomes optimum with the properties of the speech and the musical sound as used during 
learning. Thus, if the speech and the musical sound are learned together, and if the two are significantly different in 



15 



EP 0 770 985 A2 

their properties, the as-learned codebook has an average property of the two, as a result of which the performance or 
mean S/N value nnay be presunried not to be raised in case the quantizer is configured with a sole codebook. 

Thus, in the present enribodiment, the code volumes prepared using the learning data for plural signals having 
different properties are switched for improving the quantizer performance. 
' 5 Fig.9 shows a schematic structure of a vector quantizer having such two sorts of codebooks CB^^, CBb- 

Referring to Fig.9, an input signal supplied to an input terminal 501 is sent to vector quantizers 511. 512. These 
vector quantizers 511,512 own codebooks CB;^, CBq. The representative vectors or dequantized outputs of the vector 
quantizers 511 , 512 are sent to subtractors 513, 514, respectively, where the difference from the original input signal 
are found to produce error components which are sent to a comparator 515, The comparator 515 compares the error 
10 components and selects an index which is a smaller one of quantization outputs of the vector quantizers 511 . 512 by 
a changeover switch 516. The selected index is sent to an output terminal 502. 

The switching period of the changeover switch 516 is selected to be longer than the period or the quantization unit 
time of each of the vector quantizers 511, 512. For example, it the quantization unit is a sub-frame obtained by dividing 
a frame into eight, the changeover switch 516 is changed over on the frame basis. 
15 It is assumed that the codebooks CB^. CS^, having learned only the speech and only the musical sound, respec- 

tively, are of the same size N and of the same number of dimensions M. It is also assumed that, when the L-dimension 
data X made up of L data of a frame is vector-quantized with a sub-frame length M (= Un), the distortion following the 
quantization is Ejj^(k) and EB(k) if the codebooks CB^^, CB g are used, respectively. If the indices i and j are selected, 
these distortions Ep^(k) and EB{k) are represented by: 

20 

E^W = ||W, (X - C^.)|| 

,s EB(k)-llWk(X-C3.)|l 

where is a weighted matrix at the sub-frame k and C^^j. Cgj denote representative vectors associated with the indices 
i and j of the codebooks CB^, CBg, respectively. 

As for the two distortions, thus obtained, codebooks most appropriate for a given frame is used by the sum of the 
30 distortion in the frame. The following two methods may be used for such selection. 

The first method is to perform quantization using only the codebooks CB^, CBg, to find the sum of the distortions 
in the frame IkEA{k) and IkEB(k) and to use the codebook CB^ or CBg which gives a smaller one of the sums of the 
distortion for the entire frame. 

• Fig. 10 shows a configuration for implementing the first method, in which the parts or components corresponding 
35 to those shown in Fig.9 are denoted by the same reference numerals and suffix letters such as a, b, ...correspond to 
the sub-frame k. As for the codebook CB;^, the sum for the frame of outputs of subtractors 51 3a, 513b, ...51 3n, which 
give the sub-frame-based distortions, is found at an adder 51 7. As for the codebook CBb, the sum for the frame of the 
sub-frame-based-distortions is found at an adder 518. These sums are compared to each other by the comparator 515 
for obtaining a control signal or a selection signal for codebook switching at the terminal 503. 
40 The second method is to compare the distortions E;^(k) and EB(k) for each sub-frame and to evaluate the results 

of comparison for the totality of sub-frames in the frame for switching codebook selection. 

Fig, 11 shows a configuration for implementing the second method, in which an output of the comparator 516 for 
sub-frame-based comparison is sent to a judgment logic 519 for giving judgment by majority decision for producing a 
one-bit codebook switching selection flag at a terminal 503. 
45 This selection flag is transmitted as the above-mentioned S/M (speech/music) mode data. 

In this manner, plural signals of different properties can be efficiently quantized using a sole quantizer 
The frequency conversion operation by the FFT unit 161, frequency shifting circuit 162 and the inverse FFT circuit 
163 of Fig.T is now explained. 

The frequency conversion processing includes a band extraction step of taking out at least one band of the input 
50 signal, an orthogonal transform step of transforming the signal of at least one extracted band into frequency-domain 
signal, a shifting step of shifting the orthogonal transformed signal on the frequency domain to another position or 
band, and an inverse orthogonal transform step of converting the signal shifted on the frequency domain by inverse 
orthogonal transform into time-domain signals. 

Fig. 12 shows the structure for the above-mentioned frequency transform in more detail. In Fig. 12, parts or com- 
55 ponents corresponding to those of Fig,1 are denoted by the same numerals. I in Fig. 12. broad-range speech signals 
having components of 0 to 8 kHz with the sampling frequency of 16. kHz are supplied to the input terminal 101 . Of the 
broad-band speech signal from the input terminal 101 , the band of 0 to 3.8 kHz. for example, is separated as the low- 
range signal by the low-pass filter 102, and the remaining frequency components obtained by subtracting the tow- 
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range side signal from the original broad-band signal by the subtracter 151 is separated as the high-frequency com- 
ponent. These low-range and high-range signals are processed separately. 

The high-range side signal has a frequency width of 4.5 kHz in a range from 3.5 kHz to 8 kHz. which is still left 
after passage through the LPF 102. This bandwidth needs to be reduced to 4 kHz in view of signal processing with 
5 down-sampling. In the present embodiment, the band of 0.5 kHz ranging from 7.5 kHz to 8 kHz is cut by a band-pass 
filter (BPF) 107 or an LPF. 

Then, fast Fourier transform (FFT) is used for frequency conversion to a lower range side. However, prior to FFT, 
the number of samples is divided at an interval of a number of samples equal to powers of 2. for example, 512 samples, 
as shown for example in Fig.1 3A. However, the samples are advanced every 80 samples for facilitating the subsequent 
10 processing. 

A Hamming window of a length of 320 samples is then applied by a Hamming windowing circuit 109. The number 
of samples of 320 is selected to be four times as large as 80, which is the number by which the samples are advanced 
at the time of frame division. This enables four waveforms to be added later on in superimposition at the time of frame 
synthesis by overlap-and-add as shown in Fig.1 3B. 

IS The 512-sample data is then FFTed by the FFT circuit 161 for conversion into frequency-domain data. 

The frequency-domain data is then shifted by the frequency shifting circuit 162 to an other position or to an other 
range on the frequency axis. The principle of lowering the sampling frequency by this shifting on the frequency axis is 
to shift the high-range side signal shown shaded in Fig.14A to a low-range side as indicated in Fig. 14B and to down- 
sample the signal as shown in Fig. 1 4C. The frequency components aliased with fs/2 as the center at the time of shifting 

20 on the frequency axis from Fig. 1 4A to Fig. 1 48 are shifted in the opposite direction. This enables the sampling frequency 
to be lowered to fs/n if the range of the sub-band is lower than fs/2n. 

It suffices for the frequency shifting circuit 162 to shift high-range side frequency-domain data, shown shaded in 
Fig. 15. to a low-range side position or band on the frequency axis. Specifically, 512 frequency-domain data, obtained 
on FFTing 512 time-domain data, are processed so that 127 data, namely 113rd to 239th data, are shifted to the first 

25 to 1 27th positions or bands, respectively, while 1 27 data, namely 273rd to 399th data, are shifted to the 395th to 511 th 
positions or bands, respectively At this time, it is critical that the 112th frequency-domain data be not shifted to the 0th 
position or band. The reason is that the 0th data of the frequency<iomain signal is a dc component and devoid of a 
phase component so that data at this position needs to be a real number such that the frequency component, which 
is generally a complex number, cannot be introduced in this position. Moreover, the 256th data representing fs/2, 

30 generally the N/2nd data, is also invalid and is not used. That is, the range of 0 to 4 kHz should more correctly be 
represented as 0 < f < 4 kHz. 

The shifted data is inverse FFTed by the inverse FFT circuit 163 for restoring the frequency<fomain data to time- 
domain data. This gives time-domain data every 512 samples. These 512-sample-based time-domain signals are 
overlapped by the overlap-and-add circuit 166 every 80 samples, as shown in Fig. 138, for summing the overlapped 

35 portions. 

The signal obtained by the overlap-and add circuit 166 is limited by 16 kHz sampling to 0 to 4 kHz and hence is 
down-sampled by the down-sampling circuit 164. This gives a signal of 0 to 4 kHz by frequency shifting with 8 kHz 
sampling. This signal is taken out at an output terminal 169 and thence supplied to the LPC analysis quantization unit 
130 and to the LPC inverted filter 171 shown in Fig.1. 
40 The decoding operation on the decoder side is implemented by a configuration shown in Fig.1 6, 

The configuration of Fig.1 6 corresponds to the configuration downstream of the up-sampling circuit 233 in Fig. 2 
and hence the corresponding portions are indicated by the same numerals. Although FFT processing is preceded by 
up-sampling in Fig. 2, FFT processing is followed by up-sampling in the embodiment of Fig. 16. 

In Fig. 1 6. the high-range side signal shifted to 0 to 4 kHz by 8 kHz sampling, such as an output signal of the high- 
45 range side LPC synthesis filter 232 of Fig.2, is supplied to the terminal 241 of Fig. 16. 

This signal is divided by the frame dividing circuit 242 into signals having a frame length of 256 samples, with an 
advancing distance of 80 samples, for the same reason as that for frame division on the encoder side. However, the 
number of samples is halved because the sampling frequency is halved. The signal from the frame division circuit 242 
is multiplied by a Hamming windowing circuit 243 with a Hamming window 160 samples long in the same way as for 
50 the encoder side (the number of samples is. however, one-half). 

The resulting signal is then FFTed by the FFT circuit 234 with a length of 256 samples for converting the signal 
from the time axis into frequency axis. The next up-sampling circuit 244 provides a 512-sample frame length from the 
frame length of 216 samples by zero-stuffing as shown in Fig. 158. This corresponds to conversion from Fig.14C to 
Fig. 148- 

55 The frequency shifting circuit 235 then shifts the frequency-domain data to an other position or band on the fre- 

quency axis for frequency shifting by +3.5 kHz. This corresponds to conversion from Fig.1 4B to Fig.14A. 

The resulting frequency-domain signals are inverse FFTed by the inverse FFT circuit 236 for restoration to time- 
domain signals. The signals from the inverse FFT circuit 236 range from 3.5 kHz to 7.5 kHz with 16 kHz sampling. 
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The next overiap-and-add circuit 237 overlap-adds the time-domain signals every 80 samples, for each 5 1 2-sample 
frame, for restoration to continuous time-domain signals. The resulting high-range side signal is summed by the adder 
228 to the low-range side signal and the resulting sum signal is outputted at the output terminal 229. 

For frequency conversion, specific figures or values are not limited to those given in the above-described embod- 
iments. Moreover, the number of bands is not limited to one. 

For example, if the narrow band signals of 300 Hz to 3.4 kHz and the broad-band signals of 0 to 7 kHz are produced 
by 16 kHz sampling, as shown in Fig. 17, the low-range signal of 0 to 300 Hz is not contained in the narrow band. The 
high-range side of 3.4 kHz to 7 kHz is shifted to a range of 300 Hz to 3.9 kHz so as to be contacted with the low-range 
side, the resulting signal ranges from 0 to 3. 9 kHz, so that the sampling frequency fs may be halved, that is may be 8 kHz. 

In more generalized terms, if a broad-band signal is to be multiplexed with a narrow-band signal contained in the 
broad-band signal, the narrow-band signal is subtracted from the broad-band signal and high-range components in 
the residual signal are shifted to the low-range side for lowering the sampling rate. 

In this manner, a sub-band of an arbitrary frequency may be produced from another arbitrary frequency and proc- 
essed with a sampling frequency twice the frequency width for flexibly coping with given applications. 

If the quantization error is larger due to low bit rate, the aliasing noise is usually generated in the vicinity of the 
band division frequency with the use of a QMF Such aliasing noise can be evaded with the present method for frequency 
conversion. 

The present invention is not limited to the above-described embodiments. For example, the configuration of the 
speech encoder of Fig.1 or the configuration of the speech decoder of Fig. 2, represented by hardware, may also be 
implemented by a software program using a digital signal processor (DSP). Also, plural frames of data may be collected 
and quantized with matrix quantization instead of with vector quantization. In addition, the speech encoding or decoding 
method according to the present invention is not limited to the particular configuration described above. Also the present 
invention may be applied to a variety of usages such as pitch or speed conversion, computerized speech synthesis or 
noise suppression, without being limited to transmission or recording/reproduction. 

The above-described signal encoder and decoder may be used as a speech codec used in a portable communi- 
cation terminal or a portable telephone as shown for example in Figs. 18 and 19. 

Fig. 18 shows the configuration of a sender of the portable terminal employing a speech encoding unit 160 config- 
ured as shown for example in Fig.1 and Fig. 3. The speech signal collected by a microphone 661 in Fig. 18 is amplified 
by an amplifier 662 and converted by an A/D converter 663 into a digital signal which is sent to a speech encoding unit 
660. This speech encoding unit 660 is configured as shown in Figs.1 and 3. To the input terminal 101 of the encoding 
unit 660 is supplied the digital signal from the A/D converter 663. The speech encoding unit 660 performs encoding 
as explained in connection with Figs 1 and 3. Output signals of the output terminals of Figs.1 and 3 are sent as output 
signals of the speech encoding unit 630 to a transmission path encoding unit 664 where channel decoding is performed 
and the resulting output signals are sent to a modulation circuit 665 and demodulated so as to be sent via a D/A 
converter 666 and an RF amplifier 667 to an antenna 668. 

Fig. 19 shows a configuration of a receiving side of the portable terminal employing a speech decoding unit 760 
configured as shown in Fig. 2. The speech signal received by the antenna 761 of Fig.1 9 is amplified by an RF amplifier 
762 and sent via an A/D converter 763 to a demodulation circuit 764 so that demodulated signals are supplied to a 
transmission path decoding unit 765. An output signal of the demodulation circuit 764 is sent to a speech decoding 
unit 760 configured as shown in Fig. 2. The speech decoding unit 760 performs signal decoding as explained in con- 
nection with Fig. 2. An output signal of an output terminal 201 of Fig. 2 is sent as a signal of the speech decoding unit 
760 to a D/A converter 766. An analog speech signal from the D/A converter 766 is sent via an amplifier 767 to a 
speaker 768. 



Claims 

1 . A signal encoding method comprising: 

a band-splitting step for splitting an input signal into plurality of bands; and 

encoding signals of the bands in a different manner depending on signal characteristics of the bands. 

2. The signal encoding method as claimed in claim 1 wherein said band-splitting step splits an input speech signal 
having a band broader than a telephone band into at least signals of a first band and those of a second band. 

3. The signal encoding method as claimed in claim 2 wherein the signals of the lower side band of said first and 
second bands are encoded with encoding consisting in the combination of short-term predictive coding and or- 
thogonal transform coding. 
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4. The signal encoding method as claimed in claim 2 or 3 comprising: 

a short-term prediction step of performing short-term prediction on the signals of a lower side one of said first 
and second bands for finding short-term prediction residuals; 

a long-term prediction step of performing long-term prediction on the short-term prediction residuals thus found 
for finding long-term prediction residuals; and 

an orthogonal transform step of orthogonal-transforming the long-term prediction residuals thus found, 

5. The signal encoding method as claimed in claim 4 further comprising: 

a step of performing perceptually weighted quantization on the frequency axis on orthogonal .transform co- 
efficients obtained by said orthogonal transform step. 

6. The signal encoding method as claimed in claim 4 or 5 wherein modified discrete cosine transform (MDCT) is used 
for the orthogonal transform step, and wherein the transform length is made shorter and is selected to be a power 
of 2. 

7. The signal encoding method as claimed in any one of claims 2 to 6 wherein the signals of a higher side one of 
said first and second bands are processed with short-term predictive coding. 

8. A signal encoding apparatus comprising: 

band-splitting means for splitting an input signal into a plurality of bands; and 

encoding means for encoding signals of said split bands in a different manner responsive to signal character- 
istics of the band in vhich to multiplex a first signal of one of the split bands and a portion of a second signal 
of an other split band excluding a portion thereof owned in common with said first signal. 

9. The signal encoding apparatus as claimed in claim 8 wherein said band-splitting means splits a broad-band input 
signal into at least a signal of a telephone band and a signal on a side higher than said telephone band. 

10. The signal encoding apparatus as claimed in claim 8 or 9 wherein said encoding means includes 

means for finding short-term prediction residuals by short-term prediction performed on the signal of the lower 
side one of the split bands; 

means for finding long-term prediction residuals by performing long-term prediction on the short-term prediction 
residuals thus found; and 

orthogonal transform means for orthogonal-transforming the long-term prediction residuals thus found. 

11. A portable radio terminal apparatus comprising: 

amplifier means for amplifying an input speech signal; 

A/D conversion means for A/D converting the amplified signal; 

speech encoding means for encoding an output of said A/D converting means: 

transmission path encoding means for channel-decoding said encoding signal; 

modulation means for modulating an output of said transmission path encoding means; 

D/A conversion means for D/A converting said modulated signal; and 

amplifier means for amplifying a signal from said D/A conversion means for supplying the amplified signal to 
an antenna; 

wherein said speech encoding means includes a signal encoding apparatus according to claim 8, 9 or 10. 

12. A method for multiplexing an encoded signal comprising: 

a step of encoding an input signal with first encoding employing a first bit rate for producing a first encoded 
signal; 

a step of encoding said input signal with second encoding for producing a second encoded signal, said second 
encoding having a portion in common with only a portion of said first encoding and a portion not in common 
with said first encoding, said second encoding employing a second bit rate different from a bit rate for said 
first encoding; and 

a step of multiplexing said first encoded signal and a portion of said second encoded signal excluding the 
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portion thereof owned in common by said first encoding. 

1 3. The multiplexing nnethod as claimed in claim 1 2 wherein said second encoded signal is obtained by encoding said 
. broad-band input signal split into roughly a signal of the telephone signal and a signal higher in frequency than 

5 said telephone band. 

14. The multiplexing method as claimed in claim 12 or 13 wherein said common portion is the encoded signal derived 
from linear prediction parameters of the input signal. 

10 1 5. The multiplexing method as claimed in claim 12, 1 3 or 1 4 wherein said common portion is data obtained on linear 
predictive analysis of said input signal followed by quantization of parameters representing linear prediction coef- 
ficients. 

16. An apparatus for multiplexing an encoded signal comprising: 

15 means for multiplexing a first encoded signal obtained on first encoding for an input signal employing a first 

bit rate and a second encoded signal obtained on second encoding for the input signal, said second encoding 
having a portion in common with only a portion of said first encoding and a portion not in common with said first 
encoding, said second encoding employing a second bit rate different from a bit rate for said first encoding; said 
multiplexing being m..r . ; :• in such a manner that said first encoded signal is multiplexed with a portion of the second 

20 encoded signal exclu ji: .g the portion thereof owned in common by said first encoded signal. 

17. A portable radio terminal apparatus comprising: 

amplifier means for amplifying an input speech signal; 
25 AID conversion means for A/D converting the amplified signal; 

speech encoding means for encoding an output of said A/D converting means; 

transmission path encoding means for channel -decoding said encoding signal; 

modulation means for modulating an output of said transmission path encoding means; 

D/A conversion means for D/A converting said modulated signal; and 
30 amplifier means for amplifying a signal from said D/A conversion means for supplying the amplified signal to 

an antenna; 

wherein said speech encoding means further comprises: an apparatus according to claim 16. 
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(57) A method and apparatus for encoding an input 
signal, such as a broad-range speech signal, in which 
plural decoding operations with different bit rates is en- 
abled for assuring a high encoding bit rate and for nnin- 
imizing deterioration of the reproduced sound even with 
a low bit rate. The signal encoding method includes a 
band-splitting step for splitting an input signal into plu- 
rality of bands and a step of encoding signals of the 
bands in a different manner depending on signal char- 
acteristics of the bands. Specifically, a low-range side 
signal is taken out by a low-pass filter (LPF) 102 from 
an input signal entering a terminal tOI, and analyzed 



for LPC by an LPC analysis quantization unit 1 30. After 
finding the LPC residuals, as short-term prediction re- 
siduals by an LPC inverted filter 111, the pitch is found 
by a pitch analysis circuit 115. Then, pitch residuals are 
found by long-term prediction by a pitch inverted filter 
112. The pitch residuals are processed with MDCT by a 
modified DCT (MDCT) circuit 113 and vector-quantized 
by a vector-quantization (VQ) circuit 114. The resulting 
quantization indices are transmitted along with the pitch 
tag and the pitch gain. The linear spectral pairs (LSP) 
are also sent as parameter representing LPC coeffi- 
cients. 
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